OpenMPI 

In this tutorial we are going to download, install and configure OpenMPI, 
and implement simple application using it. 


We will use Windows Linux Subsystems (WSL) Ubuntu because OpenMPI 
doesn't support Windows. 


a. Download WSL Ubuntu and OpenMPI 

1. Go to Microsoft store and download Ubuntu 18.04 LTS 


Microsoft Store 

Home Gaming Entertainment Productivity Deals 
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Ubuntu 18.04 LTS 

Canonical Group Limited • Developer tools > Servers 
★ ★ ★ ★ ★ 2 & Share 

Ubuntu 18.04 on Windows allows one to use Ubuntu Terminal and run Ubuntu command line 
utilities including bash, ssh, git, apt and many more. 


Free 
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Description 

Ubuntu 18.04 on Windows allows one to use Ubuntu Terminal and run Ubuntu command line utilities 
including bash, ssh, git, apt and many more. 

Please note that Windows 10 S does not support running this app. 

2. Visit OpenMPI website to download the library. 

https://www.open-mpi.org/ 
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Open MPI: 

Open Source High Performance Computing 


Bug Tracking 
Regression Testing 
Version Information 

Hardware Locality 
Network Locality 
MPI Testing Tool 


Features implemented 01 


m development for Open MPI indude: 


• Full MPI-3.1 standards conformance 

• Thread safety and concurrency 

• Dynamic process spawning 

• Network and process fault tolerance 

• Support network heterogeneity 

• Single library supports all networks 

• Run-time instrumentation 

• Many job schedulers supported 


• Many OS's supported (32 and 64 bit) 

• Production quality software 

• High performance on all platforms 

• Portable and maintainable 

• Tunable by installers and end-users 

• Component-based design, documented APIs 

• Active, responsive mailing list 

• Open source license based on the BSD license 


Support FAQ |s«areh 


A High Performance Message Passing Library 

The Open MPI Project is an open source Message Passing Interface implementation that is developed and maintained by a consortium of academic, research, and industry partners. Open MPI is 
therefore able to combine the expertise, technologies, and resources from all across the High Performance Computing community in order to build the best MPI library available. Open MPI offers 
advantages for system and software vendors, application developers and computer science researchers. 
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Open MPI V3.0.6 released 
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Open MPI v4.0.3 released 
Bug fix release 


Mailing Lists 
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Open MPI V4.0.2 released 
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3. Download latest release of OpenMPI. 



Open MPI: Version 4.0 


Support FAQ 
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Changes in this release: 


See the .eraoo time>ne for information on the chronology of Open MPI releases. 

Current stable release downloads: 


Previous release downloads: 


Getting Help/ Support 



Checksums (GNU n»d5sum and shalsum *5.2.1) 
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4. Extract the downloaded tar file and movie it to the User folder. 

5. Now open Ubuntu and after enter user and password enter the 
following commands to move to the extracted directory: 

$ cd / 

$ cd mnt/c/Users/YourUserName/openmpi-4.0.3/ 


ili(alDESKTOP-NSlUTFC :cd / 

ili@OESKTOP-NSlUTFC:/$ cd mnt/c/Users/Ali/openmpi-4.0.3/ 
ili(SDESKTOP-NSlUTFC:/mnt/c/Users/Ali/openmpi-4.0. 3$ 
















































b. Install OpenMPI 

1. OpenMPI needs gcc and g++ compilers, to install them run: 
$ sudo apt-get update 
$ sudo apt-get install build-essential. 


B «I»®D€SCI0P-NS1UTFC: /mnt/c/Users/Ali/ofM 


ali@OESKTOP-NSlUTFC:~$ cd / 

ali@OESKTOP-NSlUTFC:/$ cd mnt/c/Users/Ali/openmpi-4.0.3/ 

ali@OESKTOP-NSlUTFC:/mnt/c/Users/Ali/openmpi-4.0.3$ sudo apt-get install build-essential 
[sudo] password for ali: 

Reading package lists... Done 
Building dependency tree 
Reading state information... Done 

build-essential is already the newest version (12.4ubuntul). 

0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 

ali@DESKTOP-NSlUTFC : /mnt/c/Users/Ali/openmpi-4.0. 3$ 


2. Before install OpenMPI, we need to check if java is available on the 
machine or not. Use: $ java -version command to see the installed 
version of java. In case of java isn't installed use: $ sudo apt install 
default-jdk or visit Oracle website and download the jdk. 


B rfCDESKlOf-NSIUTK: /mi«/c/Uwn/«Ji/o(i 


ali@DESKTOP-NSlUTFC :cd / 

ali@DESKTOP-NSlUTFC:/$ cd mnt/c/Users/Ali/openmpi-4.0.3/ 

ali@DESKTOP-NSlUTFC:/mnt/c/Users/Ali/openmpi-4.0. 3$ sudo apt-get install build-essential 

[sudo] password for ali: 

heading package lists... Done 

3uilding dependency tree 

Reading state information... Done 

suild-essential is already the newest version (12.4ubuntul). 

3 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 
ali£)DESKTOP-NSlUTFC:/mnt/c/Users/Ali/openmpi-4.0.3$ java -version 
apenjdk version "11.0.6" 2020-01-14 

DpenDDK Runtime Environment (build 11.0.6+10-post-Ubuntu-lubuntull8.04.l) 

DpenDDK 64-Bit Server VM (build 11.0.6+10-post-Ubuntu-lubuntull8.04.1, mixed mode, sharing) 

ali@DESKTOP-NSlUTFC:/mnt/c/Users/Ali/openmpi-4.0.3$ 





3. Now run: $sudo ./configure --enable-mpi-java — 
prefix="/home/$USER/.openmpi" to configure OpenMPI 
installation. (This will take some time). 

4. After finishing, run: $ sudo make all install to compile and install 
OpenMPI. (This will take some minutes). 

5. After installing we need to set our environment path to 
environment variables. 

$ export PATH="$PATH:/home/$USER/.openmpi/bin" 

$ export 

LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/home/$USER/.openmpi/l 
ib /" 

6. Now we can test our environment using the examples that comes 
with the library files which are in examples folder. To go to 
examples folder run: 

$ cd examples/ 

7. The command for compile java files is: 

$ mpijavac file-name.java 

The command for run is: 

$ mpirun [options] java [your-java-options ...] your-app-class 

The mpirun option we will use is the number of processes which 
specified using -n number-of-processes (maximum number is the 
number of cores in your CPU or you can double it by allowing multi 
process per core see OpenMPI website for more details). 

Lets take the Hello.java example. 

To compile: $ mpijavac Hello.java 
To run: $ mpirun -n 6 java Hello 


ali@DESKTOP-NSlUTFC : /mnt/c/Users/Ali/openmpi/openmpi-4.0. 3$ cd examples/ 
ali@DESKTOP-NSlUTFC:/mnt/c/Users/Ali/openmpi/openmpi-4.0.3/examples$ mpijavac Hello.java 
ali@DESKTOP-NSlUTFC:/mnt/c/Users/Ali/openmpi/openmpi-4.0.3/examples$ mpirun -n 6 java Hello 


WARNING: Linux kernel CMA support was requested via the 
btl_vader_single_copy_mechanism MCA variable, but CMA support is 
not available due to restrictive ptrace settings. 

The vader shared memory BTL will fall back on another single-copy 
mechanism if one is available. This may result in lower performance. 

Local host: DESKTOP-NS1UTFC 

Hello world from rank 0 of 6 
Hello world from rank 5 of 6 
Hello world from rank 2 of 6 
Hello world from rank 1 of 6 
Hello world from rank 3 of 6 
Hello world from rank 4 of 6 

[DESKTOP-NS1UTFC:17961] 5 more processes have sent help message help-btl-vader.txt / cma-permission-denied 
[DESKTOP-NS1UTFC:17961] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages 

ali@DESKTOP-NSlUTFC:/mnt/c/Users/Ali/openmpi/openmpi-4.0.3/examples$ 






c. Develop our own program 

Our simple program root process (rank 0) will generate an array of 
10000 random integers, then it will scatter the array over the 
processes (ranks) each process will sum the part which it received 
from root process and find the minimum and maximum values in its 
part, after that we will combine the summations to get the total 
summation into the root process and find the global minimum and 
maximum which will calculate the average and display the total 
summation, average, maximum and minimum values. 

1. We will develop our program using java, we will use Intellij for 
writing the codes (You can use any editor you want). 

2. Create a new project called OpenMPI. 

3. First step is to add the MPl.jar file to the project libraries. 

4. Go to File -> Project Structure -> Libraries -> + -> JAR 

5. To Find the mpi.jar in the ubuntu bash run: 

$ find / -name mpi.jar, once you see mpi.jar press Ctrl + C to stop 
searching. 
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*li§DESKTOP-NSlUTFC:/mnt/c/Users/ali/openmpi$ find / -name mpi.jar 
find: Vetc/polkit-l/localauthority*: Permission denied 
find: '/etc/ssl/private': Permission denied 
/home/ali/.openmpi/lib/mpi.jar 

find: Vmnt/c/$Recycle.Bin/S-l-5-18': Permission denied 

find: 7mnt/c/$Recycle.Bin/S-l-5-21-2112231479-620254285-2465943988-1000 , : Permission denied 
find: 7mnt/c/$Recycle.Bin/S-l-5-21-2112231479-620254285-2465943988-500': Permission denied 
find: Vmnt/c/Config.Msi': Permission denied 


ili$OESKTOP-NSlUTFC : /mnt/c/Users/ali/openmpi$ 



6. Now open Windows explorer and at address bar write \\wsl$, this 
will show you all subsystems that are in your machine. 



■ oUoidl 


■ JtfUkd4jul 
Q OneOnve 

gi«>c 

3 30 Ofcjects 


3 OwnlMds 

> M«c 

■ Videos 
_ locol Do* (C) 

:> Networl 


7. Now go to the address you found using find command in ubuntu 
bash. 
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8. Copy the path and paste it in Intellij. 
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9. Now start write the code. 

10. Add throws MPlException to main signature. 

11. Then Start with initialization of the array: 
int arraySize = 10000; 

// Randomize the array elements 

Random random = new Random(); 
int array [] = new int [arraySize]; 
for (int i = 0; i<array.length; i++){ 
array[i] = random.nextInt(); 

} 

12. After that we will initialize the MPI execution environment. 

MPI.Init(args); 

13. Then using rank method each process will get its rank. 

int rank = MPI.COMM_WORLD.getRank(); 

14. Then using size method each process will get the number of 
processes. 

int size = MPI.COMM_WORLD.getSize(); 

15. Now calculate the size of each partition of the array which will send 
to a process (array size / number of processes) and declare a 
subarray to hold that partition. 

int partitionSize = arraySize/size; 
int [] sub = new int [partitionSize]; 
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8. Using scatter method we will partition the original array over the 
processes. 

MPI.COMM_WORLD.scatter(array,partitionSize 
,MPI.INT,sub,partitionSize,MPI.INT, 0 ); 

The scatter method parameters in the order are: 
sendbuf - send buffer (OpenMPI use java arrays as buffers) 
sendcount - number of items to send (In each partition) 
sendtype - datatype of each item in send buffer 
recvbuf- receive buffer 
recvcount - number of items to receive 
recvtype - datatype of each item in receive buffer 
root - rank of sending process 

9. Now each processes received its partition and it will calculate the 
summation in the variable sum and find the maximum and minimum 
values and store them in the max and min variables. 

int sum = 0; 

int index = 0; 

while (index<partitionSize) { 

sum = sum + sub[index]; 
index++; 

} 

10. Now each process has the summation and maximum and minimum 
values of its partition, lets prepare the buffers. Because the message 
passing done using buffers, we will declare two arrays for each value 
one for sending and another one for receiving (OpenMPI use java 
arrays as buffers). 

int [] sumBuf = {sum}; 

int [] maxBuf = {max}; 

int [] minBuf = {min}; 

int [] sumRecBuf = new int[l]; 

int [] maxRecBuf = new int[l]; 

int [] minRecBuf = new int[l]; 


11. using reduce method we will combine the summation of each 
process to get the total summation, combine the maximum values 
to find global maximum and combine the minimum values to find 
global minimum. 

//Total summation 

MPI.COMM_WORLD.reduce(sumBuf, sumRecBuf, 

1 , MPI.INT, MPI.SUM, 0); 

//Global max 

MPI.COMM_WORLD.reduce(maxBuf, maxRecBuf, 

1 , MPI.INT, MPI.MAX, 0); 

//Global min 

MPI.COMM_WORLD.reduce(minBuf, minRecBuf, 

1, MPI.INT, MPI.MIN, 0); 

The reduce method parameters in the order are: 

sendbuf-send buffer 

recvbuf - receive buffer 

count - number of items in send buffer 

type - data type of each item in send buffer 

op - reduce operation (sum, subtract or any one of the predefined 

opeartions) 

root - rank of root process 

12. After that the root process (rank = 0) will calculate the average and 
display the total summation, average, maximum and minimum 
values. 

if (rank==0){ 

System.out.println( "Sum is: " + 
sumRecBuf[ 0 ]); 

System.out.println( "Average is: " + 
sumRecBuf[ 0 ]/arraySize) ; 

System.out.println( "Max is: " + 
maxRecBuf[ 0 ]); 

System.out.println( "Min is: " + 
minRecBuf[ 0 ]); 

} 

13. At the end finalize our MPI execution environment using: 

MPI.Finalize (); 


14. Remove package name and save the file. 

15. Go to the directory where you save the file. 

$ cd some/directory 

16. Compile the program using mpijavac: 

$mpijavac Main.java 

17. Run the program using mpirun: 

$mpirun -n number_of_processes java Main 

® aligDESIOOP-NSlUTFC:/mnt/c/UseVAJi/ldeaProjects/OpenMPI/src/alidomlo — 0 X 


ili@DESKTOP-NSlUTFC:/mnt/c/Users/Ali/IdeaProjects/OpenMPI/src/alidomlo$ mpijavac Main.java 
ili@OESKTOP-NSlUTFC:/mnt/c/Users/Ali/IdeaProjects/OpenMPI/src/alidomlo$ mpirun -n 6 java Main 


WARNING: Linux kernel CMA support was requested via the 
btl_vader_single_copy_mechanism MCA variable, but CMA support is 
not available due to restrictive ptrace settings. 

The vader shared memory BTL will fall back on another single-copy 
mechanism if one is available. This may result in lower performance. 

Local host: DESKTOP-NS1UTFC 


Sum is: 786065711 
Average is: 78606 
Max is: 2146712080 
Min is: -2146931916 

[DESKTOP-NS1UTFC:01071] 5 more processes have sent help message help-btl-vader.txt / cma-permission-denied 
[DESKTOP-NS1UTFC:01071] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages 

ali@DESKTOP-NSlUTFC:/mnt/c/Users/Ali/IdeaProjects/OpenMPI/src/alidomlo$ 





